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ABSTRACT 

An evaluation was done of the New York City Public 
Schools' Student Upgrading through Computer and Career Education 
Systems Services Program (Project SUCCESS) . Project SUCCESS ci^erated 
at 3 high schools in Brooklyn and Manhattan (Murry Bergtraum High 
School, Edward R. Murrow High School, and John Dewey High School). It 
enrolled limited English proficient (LEP) immigrant students, of whom 
72 percent were eligible for the free lunch program; 363 students 
were enrolled In the fall and 279 students were enrolled in the 
spring of the 1990-91 school year. Project SUCCESS offered 
instruction in English as a Second Language, native language arts 
instruction in Chinese and Spanish, bilingual instruction in content 
area subjects, career orientation services, academic advisement, and 
college/university consultation for target students. Project SUCCESS 
also attempted to increase parents' awareness of career opportunities 
open to their children. The evaluation was conducted using student 
and director questionnaires, test scores, and interviews. Evaluation 
findings indicate that the program staff helped newly-arrived LEP 
students make a sirooth transition into the New York City Public 
School system and encouraged parents to actively participate in 
various school programs. However, full computer programming was 
available only for students who speak Chinese or Spanish. It is 
recommended that Russian guidance and instruction services be added 
to serve the program's large Russian-speaking population. (JB) 
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FOREWORD 



The body of this report is preceded by an Extract which presents an overview of salient points of 
the project: funding cycle; enrollment figures; background of students served; admission criteria; and 
programming features, strengths, and limitations, including the outcome of all objectives. The extract also 
presents the conclusions drawn by the Office of Research, Evaluation, and Assessment (OREA) about the 
program and its recommendations for program improvement. 

The extract is followed by the body of the report, titled Program Assessment . This includes such 
information as staffing, program implementation, and outcome and implementation objectives. 
Instructional objectives are presented first, followed by noninstructional objectives. The report then 
addresses those aspects of programming mandated by Title VII regulations that do not have specifically 
stated objectives. This may be information on attendance and dropout rate, grade retention, 
mainstreaming, referrals out of the program to meet special needs of the students, and withdrawals. A 
case history concludes the report. 

Data for this profile were collected and analyzed using a variety of procedures, which are 
described in Appendix A following the text. 
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EXTRACT 



PROJECT DIRECTOR: Tim Law 



FUNDING CYCLE: Year 1 of 3 



SITES 



High School 

Murry Bergtraum 
Edward R. Murrow 
John Dewey 



Borough 

Manhattan 

Brooklyn 

Brookfyn 



(faU) 
89 
170 
104 



Enrollment* 



(spring) 
0 
174 
ICS 



'"The project enrolled 375 students, serving 363 in the fall and 279 in the spring. 



STUDENT BACKGROUND 



Native Language Number of Students 



Chinese 250 

Mandarin 28 

Cantonese 222 

Russian 66 

Spanish 33 

Other Languages 19 

Unknown 7 



Countries of Origin Number of Students 

China 191 
U.S.S.R. 67 
Hong Kong 31 
Other countries 75 
Unknown 11 



Mean Years of Education in Native Country : 6.4; in the United States : 3.1 
Percentage of Students Eligible for Free Lunch Program : 72.3 



ADMISSION CRITERIA 

The project admitted students who scored at or below the 40th percentile on the Language Assessment 
Battery (LAB). Other factors taken into account were home language, high school applications, remediation 
cligibilit;' status, evaluation of foreign transcripts, performance on teacher-made tests for native language 
proficiency, performance on New York City Regents competency tests (R.C.T.s), a guidance placement interview, 
and parental pennission. 
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PROGRAMMING 



Features 

Project SUCCESS targeted three high schools with an influx of immigrant students of limited English 
proficiency (LEP). The project offered instruction in English as a Second Language (E.S.L.), Native Language 
Arts (N.L.A.) in Chinese and Spanish, and bilingual instruction in content area subjects. Project SUCCESS 
provided career orientation services, academic advisement, and college/university consultation, for target students. 
The project also attempted to increase parents' awareness of career opportunities open to their children. 

Strengths and Limitations 

Staff helped newly-arrived LEP students make a smooth transition into the New York City school system 
and encouraged parents to actively participate in various school programs. However, full programming was 
available for Chinese- and Spanish* speakers only. 

CONCLUSIONS AND RECOMMENDATIONS 

Project SUCCESS was fully implemented. The project met its objectives for E.S.L., N.L.A., content area 
subjects, field trips, attitude toward school and heritage, career development, and curriculum development. It met 
one objective for staff development and partially met its objective for attendance. Project SUCCESS did not 
meet its objective for dropout prevention. Because the project did not provide the necessary data, OREA was 
unable to evaluate one objective for staff development and the objective for parental invohrement. 

The conclusion, based on the findings of this evaluation, lead to the following recommendations: 

• If funds permit, provide Russian guidance and instruction services to project's large Russi^'ti 
population. 
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PROGRAM ASSESSMENT 



STAFFING 

Title VI! Staff (Total 4) 
Title 

Project Director 
Bilingual Specialist 
Bilingual Specialist 
Teacher Specialist 



Degree 

M.S., M.A., P.D. 

M.S. 

B.A. 

M.A. 



Language Competencies 

Cantonese, Mandarin, Makaa,Toiyshan 

Mandarin 

Cantonese, Mandarin 
Chinese 



Other Staff Working With Project Studen ts (Total 24) 



Degree 

Ph.D. 

M.S. 

M.B.A. 

B.A. 

B.S. 

A.A. 



2 
4 
1 
6 
1 
1 



Certification 

Chinese 1 

Bil. Biology 2 

Bil. Social Stud. 3 

E.S.L. 5 

Social Studies 1 

Common Branches 1 

Math Ancillary 3 

General Science 2 

Bilingual Guidance 1 



Language Competencies 
Spanish 5 
Chinese 13 
English 14 
Hebrew 1 



IMPLEMENTATION AND Oil TCOMES (Objectives prefaced by •) 
English as a Second Language (E.S.L.) 

Periods Weekly 

Murray Bergtraum High School John Dewey High School Edward R. Murrow High School 



Level 

Literacy 

Beginning 

Intermediate 

Advanced 

Transitional 



0 
10 
10 
5 
5 



0 
15 
10 
10 
10 



5 
5 
5 
5 
5 



Teachers employed a participative, interactive style of learning, i.e., stoiy-telling, role-playing, and games. 
• Seventy percent of the target students will demonstrate an appropriate increase in English proficiency. 
Evaluation Instrument: Language Assessment Battery (LAB)* 
Pretest: March 1990; posttest: March 1991. 



* OREA used a gap reduction evaluation design to measure the change in LEP students' language 
proficiency that could be attributed to the project. Since all LEP students in New York City aro entitled to 
supplementary instruction, a comparison group that did not receive services was unavailable. Instead, OREA 
used Normal Curve Equivalents (N.C.E.s) to compare project students' gains with those of the groups on which 
the test data were normed. It is assumed that the norming groups would show a gain of zero N.C.E.s. 
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Number of students for whom pre- and posttest data were reported: 278. Of these, 70.1 percent passed. 

Mean gain: 10.4 N.C.E.s (s.d.= 13.9) 

Mean gain is statistically significant (t- 12.46, e<.05). 

Project met objective* 

Native Language Arts (N.L.A.) Chinese, Spanish 

Estimated percentage of students lacking literacy skills in native language: 60 

All three schools offered beginning, intermediate, and advanced levels of N.L.A. for five periods weekly. 
Murry Bcrgtraum and Edward R. Murrow high schools also offered advanced placement N.L.A. five periods 
weekly. 

In N.L.A. classes a paraprofessioual was available to explain terminology when necessary. Cooperative 
learning was a motivating technique for encouraging participation and maintaining interest. 

• Seventy-five percent of the Chinese-dominant participants wilt demonstrate a significant increase in 
Chinese. 

Evaluation Instrument: Final course grades. 

Of the 202 students enrolled in N.L.A. in the fall, 89.6 percent passed. Of the 192 enrolled in spring, 95.3 
'Crcent passed. 

Project met objective. 

• Seventy five percent of the Spanish-dominant participants will demonstrate a significant increase in 
Spanish language achievement. 

Evaluation instrument: La Prueba de Lectura 

Project SUCCESS failed to provide the data necessary to evaluate this objective. 

OREA could not evaluate objective. 

Content Area Subjects 

Instruction in content area subjects was bilingual. Class notes and homework assignments were developed 
in Chinese and Spanish, stressing dffflcult vocabulary. Visual aids such as videotapes, maps, and pictures further 
clarified difHcult subject-matter. Instructors encouraged students to work together and used peer tutoring to 
problem-solve. 
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• At least 70 percent of all targeted students will score at or above the 65 percent passing criterion in 
the subject areas of social studies, mathematics, and science* 
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Evaluation Instrument: Fmal course grades. 

Passing Grades in Content Area Courses 

Eall Spring ^ 

Enrollment Percent Passing Enrollment Percent Passing 

Mathematics 336 85.1 318 83.3 

Science 291 77.3 278 84.2 

Social studies 347 76.9 333 80.8 

Project met objective* 

Attendance and Dropcut 

• Participating students* attendance will be significantly higher than that of mainstream students. 

Attendance Rate 

School Project Students' Rate Mainstream Students' Rate z«Score 

Muriy Bergtraum High School 97.5 82.1 3.89' 

Edward R. Murrow High School 87.7 903 -1.16 

John Dewey High School 92.8 89.4 1.14 

*E<.05 

Project met objective at Murry Bergtraum High School only. 

• Program students will have a significantly lower dropout rate than similar non program students. 

Dropout Rate 

School Project Students' Rate Mainstream Students' Rate z-Score 

Muriy Bergtraum High School 0 2.2 -1.45 

Edward R. Murrow High School 1.1 1.5 -4.34 

John Dewey High School 0 2.7 -1.72 

The differences between project and mainstream students' attendance rates were not statistically 
significant at any of the three schools. 

Project did not meet objective. 

Attitude Toward School and Heritage 

• Seventy-five percent of ail target students will demonstrate an improvement in attitude toward one's 
heritage. 

Evaluation Instrument: Cultural heritage attitude scale (5-point Likert scale). 

Pre- and post-test data were available for 280 students. Of these, 249 (88.9 percent) showed an improved 
attitude toward their heritage. 

Project met objective. 
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• Seventy-five percent of all target students will demonstrate an improvement in attitude toward school. 

Evaluation Instrument: Likert scale measuring interest in continuing education. 

Pre-and post test data were available for 280 students. Of these, 243 (86.8 percent) showed an 
improvement in attitude towards education. 

Project met objective. 

Field Trips 

• The program will organize at least three field trips for the targeted students at the three school sites, 
to historical museums, United Nations, White House etc., to increase their familiarity with American 
culture and citizenship. 

Project students made several field trips to places of historical significance. 

Project met objective. 

Career Development 

• All graduating students will meet with the bilingual career specialist for advisement at least three 
times during ihe school year. 

Target students met with the bilingual career specialist in each of the three project sites once a month 
and discussed occupational interests and job placement opportunities. 

Project met objective. 

• The program will organize at least one conference for students in which the representatives of 
business and industry will present information on career options and skill requirements. 

The third annual Bilipgual Career Day was conducted by the project director on November 2^ 1990 at 
Long Island University, Brooklyn campus. Seven hundred LEP students attended this conference at which 
specialists in each field discussed career topics. 

Project met objective. 

Staff Development 

• Ninety percent of program staff members will enroll in at least one university course each semester 

All project staff took courses in bilingual education, parental involvement, and/or teaching methods and 
skills at either Long Island University, Fordham University, or the City University of New York. Title VII 
reimbursed teachers for their tuition. 

Project met objective. 

• Eighty percent of the staff in the program will demonstrate an increase in awareness of pupil needs 
and problems. 

Evaluation Instrument: Five*point Likert scale of needs and problems. 
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APPENDIX A 



DATA COLLECTION AND ANALYSIS 

Student Data Form 

This one-page form is filled out by staff for each participating and mainstreanied student. ORFA gathers 
data from this form on backgrounds^ demographics, academic outcomes, attendance^ referrals^ and exit from the 
program. 

Project Director's Questionnaire 

The Project Director's Questionnaire includes questions on staff qualifications, program iniplenicntalion, 
periods of instruction, and instructional materials and techniques. 

Project Director's Interview 

The interview gathers information on program and student or staff characteristics not supplied by the 
Project Director's Questionnaire. The interview also allows project staff to offer qualitative data or amplify 
responses to the Questionnaire. 

Citvwide Test Scores 

OREA retrieves scores centrally from the Language Assessment Battery (LAB) and other citywide tests. 
For evaluation purposes, these test scores are reported in Normal Curve Equivalents (N.C.E.s). N.C.E.s are 
normalized standard scores with a mean of 50 and a standard deviation (s.d.) of 21.06. They constitute an equal- 
interval scale in which the distance is the same between any two adjacent scores. A gain of 5 N.C.E.s is the same 
whether it is at the lower or the higher end of the scale. N.C.E.s can be used in arithmetic computations to 
indicate group progress. (Percentile scales, although more familiar to many, are unsuitable for such computations 
since they are not equal^nterval.) 

Likert-Tvpe Surveys 

Likert-type surveys, in which respondents mark their opinions on a scale from one to five, are used in a 
variety of ways. They examine student attitudes (i.e., toward school and career, native language use, and native 
and mainstream cultures). They also assess staff and parent attitude and reactions to workshops and other 
activities. 

Gap Reduction Evaluation Design 

OREA uses a gap reduction design for measuring changes in standardized tests. Since no appropriate 
non-project comparison group is available in New York City, where all students of limited English proficiency 
(LEP) are entitled to receive supplementary services, OREA compares the progress of participating students with 
that of the group on which the test was normed. It is assumed that the norm group would show a zero gain in 
the absence of instruction, and gains made by project students could be attributed to project services. 
(See "Citywide Test Scores" above.) 

To test whether pre/posttest gains are greater than could be eTcpected by chance alone, OREA uses a 
t-test. To determine whether a difference between two proportions (e.g., program and mainstream attendance 
rates) is greater than could be expected by chance, OREA uses a j-test. The level of significance is set at .05 for 
all tests. 
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APPENDIX B 



INSTRUCTIONAL MATERIALS 



Edward R. Murrow High School 



Biology and Human Process 
RCT Science Review for NYS 



Integrated Mathematics 
Mathematics 
de Addison Wesley 
1 Can Learn Spanish 



Science 

Tanzer, Charles 



Mathematics 
Dressier & Keenan 



Prentice Hall 
Prentice Hall 



Amsco 

Addison Wesley 



N.Y.C. Board of Education 



Eastern Hemisphere: 

Europe, Asia, 
Africa & Oceana 
El Mundo y Su Gente 

Murry Bergtraum High School: 

Integrated Mathematics 

Course I 
Integrated Mathematics 

Course II 
Basic Geometry 



Social Studies 
Foresman, Scott 



Cooper, Kenneth 

Mathematics 
Keenan & Dressier 

Keenan & Dressier 

Jurgensen & Brown 



Schreiber, Steper, Patrich 
Silver Burdett Co. 

Amsco 
Amsco 



Chinese Text 
Chinese Text 



Chinese 

Chinese Culture Press 
Government of Hong Kong 



Selected Tang & Song Poems Government of Hong Kong 



Interchange 2 
Achieving Competence in 
Reading & Writing 
Impact-SO Short Stories 
Outsiders-American Short 

Stories 
Write from the Start 



Series 7 Typing 
Century 21 Typing 
Typewriting Speed- 
Control Builders 



E.SX. 

Richards, Jack 

Christ, H.L 
Safier, F 

Mullen, J.S. 
Davidson, D.M. 

Taxing 



Science 



Biology-An Everyday Experience 
Review Guide for Biology 
Physical Science 



Cambridge University Press 
Amsco 

Harcourt Brace Jovanovich 

Prentice Hall Regents 
Newbury House 



Gregg-McGraw Hill 
Southwestern 

Southwestern 



Charles E. Merrill 
Charles E. Merrill 
Prentice Hall 
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Social Studies 

People & Our World 
U^S.H.G. RCT Review Text 
Economics 

Bilingual Computer Science: 

DBase III Programmer's Reference 
Computer Programming RPG II 



John Dewey High School: 

Afro-Asian Studies 
Guide 

Exploring World Cultures 
World History 
Global Insights 
Our Common Heritage 
World History 



Social Studies 
Lefton, Philip 

Newhill, Esko 
Beers, Burton 
Hantula 
Roselle, Daniel 
WaUbank 



Holt, Rinehart, Winston 
N & N Publishing 
Amsco 

PNS-KENT 
Shally & Cashman 



Barrons 

Ginn & Company 
Prentice Hall 
Merrill 
Ginn & Co. 
Scott Foresman 



Science 



Modern Biology 
Physical Science 
RCT Science Reviews 



Integrated Mathematics 

Course I 
Integrated Mathematics 

Course II 



Mathematics 
Dressier & Keenan 

Dressier & Keenan 



Globe Book Co. 
Prentice Hall Inc. 
Seward Park High School 



Amsco 
Amsco 



Put It in Writing 
Modern Short Stories 
Ready to Write 
Cause & Effect 
English With a Smile 
Write From the Start 
Everyday English 2 



E.S.L. 

Blott Davidson 
Dixon, R. 
Blanehard, Root 
Ackert, D. 
KruliktZaffran 
Davidson, Blott 
Krulik, Zaffran 



Newbury House 
Prentice Hall 
Longman 
Newbuiy House 
Natl Textbook Co. 
Newbury House Inc. 
Nat'l Textbook Co. 
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